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PREFACE 


For  the  56  major  Army  programs^  covered  by  the  selec¬ 
ted  acquisition  reports  (SAR's)  as  of  September  30,  1979, 
there  was  a  cost  growth  of  19.6  billion  dollars  or  49% 
over  the  baseline  estimate  as  reported  by  the  General 
Accounting  Office.^"  Although  70%  of  this  cost  growth  was 
attributed  to  changes  in  quantities  of  items  procured 
and  inflation,  $2.9  billion  dollars  or  1670  was  attributed  to 
cost  estimating.  The  objective  of  this  report  is  to  pro¬ 
vide  analysts  with  an  additional  tool  for  estimating  cost 
and/or  time  when  data  bases  are  not  available  with  which 
to  develop  traditional  parametric  statistical  relation¬ 
ships  . 


Defense  defined  major  programs  are  those  with  an  estimated 
research,  development ,  test,  and  evaluation  (RDT&E)  cost  ex¬ 
ceeding  $75  million  or  an  estimated  production  cost  exceed¬ 
ing  $300  million.  The  56  Army  programs  conform  to  this 
definition. 


INTRODUCTION 


Much  has  been  written  about  developing  cost  estima¬ 
ting  relations  (CER's)  based  upon  historical  data.  The 
decision-maker  requires  and  needs  more  than  a  point 
estimator  to  evaluate  the  associated  risks  of  developing 
and  fielding  a  new  system.  Therefore,  methodology  has 
been  developed  for  estimating  the  range  of  future  system 
costs  and  their  associated  probability  distributions 
based  upon  this  historical  data.  However,  with  the  rapid 
development  of  exotic  weapon  systems,  new  manufacturing 
methods,  and  new  composite  materials,  historical  data  bases 
are  not  sufficiently  analogous  to  the  new  system  and/or  the 
physical/performance  characteristics  of  the  new  system  are 
beyond  the  reliable  ranges  of  the  data  base.  Consequently, 
estimates  for  the  new  system  frequently  depend  upon  expert 
opinion  of  a  very  few  knowledgeable  persons. 

When  CER's  are  "somewhat"  analogous  but  inadequate 
(for  reasons  mentioned  above) ,  the  method  frequently  used 
is  to  get  expert  opinion  adjustment  factors,  e.g.,  1.4 
times  CER  estimate.  Although  this  may  be  the  best  point 
estimate  available,  the  decision-maker  still  needs  an  in¬ 
dicator  of  the  risks  involved,  i.e.,  some  measure  of  how 
much  the  estimate  could  be  in  error.  The  method  proposed 
in  this  paper  provides  this  information. 


I  would  like  to  emphasize  that  the  method  presented  is  a 
complimentary  procedure.  Wien  sufficient  historical  or  engineering 
data  is  available,  standard  statistical  procedures  should  be  used  or 
axrplecnented  by  the  proposed  method. 


♦ 


PROPOSED  METHOD 


GENERAL: 

a .  Uncertainty  (risk)  of  an  activity*  can  be  described  by  a 
probability  distribution.  This  uncertainty  relates  to  potential 
technical  risks  and  economic  factors.  Another  major  source  of 
uncertainty,  not  covered  in  this  paper,  is  requirements  uncertainty, 
e.g.,  changes  in  performance  requirements  and  quantity  procured. 

For  a  given  risk  assessment,  requirements  are  assumed  to  be  fixed. 
Program  uncertainty  is  a  convolution  of  the  activities  risks. 

b.  To  determine  program  uncertainty,  a  PERT  type  network  must 
be  developed  displaying  the  activities  and  events  and  their  major 
interdependencies.  This  network  should  be  correlated  to  the  elements 
of  the  program  work  breakdown  structure.  For  each  activity,  a  distri¬ 
bution  describes  the  uncertainty  involved  in  that  activity.  When 
applicable  historical  data  is  available  or  factors  assumed,  appropriate 
distributions  should  be  used.  This  paper  describes  a  method  of 
estimating  activity  distributions  when  the  above  is  not  available. 

c.  Once  the  activity  distributions  and  parameters  are  specified, 
a  total  program  (or  intermediate  milestone)  probability  distribution 
can  be  derived  by  Monte  Carlo  simulation.  Three  models  (RISCA, 

SOLVNET  and  VERT)  are  described  in  DARCOM  Handbook  11-1.1-79,  Army 
Programs:  Decision  Risk  Analysis  Handbook?  Of  the  models  known  by  the 
author,  VERT  (Venture  Evaluation  and  Review  Technique)  is  the  most 


*  Activity  is  defined  as  the  time  or  cost  to  complete  a  task  whereas 
an  event  is  a  point  in  time,  e.g.,  start  of  flight  testing. 
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versatile  and  is  used  la  the  sample  case  In  a  subsequent  section. 

Also  reference  article  from  Defense  Management  Journal,  "VERT:  A  risk 
analysis  tool  for  program  management",  contained  herein  as  Appendix  A. 

d.  A  major  shortcoming  of  most  risk  models  is  the  limited  number 
of  distributions  built  Into  the  basic  program  and/or  the  amount  of  sub¬ 
jective  probabilistic  data  to  be  requested  from  the  "expert."  Since 
many  activity  distributions  are  skewed  to  the  right,  l.e.,  the  possible 
range  of  an  overrun  exceeds  that  of  an  underrun,  the  standard  normal 
distribution  Is  not  appropriate.  Also,  the  frequently  used  triangular 
distribution  can  easily  misrepresent  the  probability  densities  as 
shown  by  an  example  In  Appendix  B.  The  VERT  program  allows  the 
analyst  a  choice  of  over  a  dozen  density  functions.  These  can  be 

used  to  describe  activities  In  terms  of  time  and/or  cost. 

e.  Eor  a  program  with  many  activities,  the  Central  Limit  Theorem 
(CLT)  provides  an  unbiased  estimate  of  the  expected  mean  and  variance 
of  the  total  program  cost*  by  simply  adding  the  expected  values 

of  the  activity  means  and  variances  since  the  limiting  distribution 
of  additive  variables  (even  from  skewed  distributions)  Is  normal. 
However,  for  a  few  skewed  activities,  or  domination  by  a  few  skewed 
activities,  or  intermediate  milestone  distributions  based  upon  a  small 
number  of  skewed  activities,  application  of  the  CLT  can  give  misleading 
results  regarding  variance  and  skewness. 


*  Estimates  of  program  time  or  cost  as  a  function  of  time  generally 
cannot  use  the  CLT.  While  the  expected  mean  for  time  can  be  computed 
along  the  critical  path,  the  distribution  for  time  or  cost  for 
several  activities  requires  more  sophisticated  techniques,  e.g., 
s imulat ion . 


SELECTION  OF  DIS TRI BUT  ION  (  S )  : 

a.  When  the  analyst  must  determine  the  activity  distributions 
from  subjective  inputs,  the  analyst  usually  can  only  zero  in  on  the 
general  shape  of  the  distribution  and  its  associated  parameters. 
Consequently  the  following  criteria  was  used  to  select  a  distribu¬ 
tion  or  distributions: 

1.  Simplicity 

2.  Could  be  symmetric,  skewed  left,  or  skewed  right 

3.  Could  have  varying  degrees  of  kurtosis,  i.e.,  concentration 
around  mean  or  mode 

4.  Could  be  normalized  for  computer  simulation 

b.  During  the  1960's,  several  theoretical  papers  (See  References 
3  thru  8)  where  written  regarding  cost  uncertainty.  All  of  the 
authors  of  these  papers  chose  the  beta  probability  function  to 
describe  activities  because  of  its  versatility  and  simplicity. 

Because  of  the  large  amount  of  computer  core  and  central  processing 
unit  (CPU)  time  required  to  run  a  Monte  Carlo  simulation,  most  of 
these  earlier  authors  advocated  the  convolution  of  beta  distributions 
by  the  method  of  moments.  This  method  provides  a  total  program  cost 
distribution  profile  but  suffers  from  the  same  shortcomings  as  using 
the  Central  Limit  Theorem  discussed  earlier.  During  the  decade  of 
the  1970's,  little  use  has  been  made  of  this  research.  However,  with 
todays  high  speed  computers,  a  complex  network  can  be  simulated  via 
Monte  Carlo  techniques  much  more  efficiently.  (Using  the  VERT  program, 
a  complex  network  can  be  simulated  1000  times  with  under  240K  core  and 
under  2  minutes  CPU  time.) 


c.  This  author  evaluated  several  distributions  (triangular, 
gamma,  velbull,  beta,  et  al.)  and  reached  the  same  conclusion 

that  the  beta  function  could  adequately  describe  moat  activity  dis¬ 
tributions  and  vas  generally  superior  to  other  probability  functions 
vis-a-vis  the  criteria  listed  above-  The  preceeding  statement  is 
not  meant  to  suggest  the  exclusive  use  of  the  beta  distribution  when 
acquiring  subjective  inputs.  There  are  situations  where  other  distri¬ 
butions  maybe  more  appropriate,  e.g.,  the  Poisson  distribution  for  the 
expected  life  of  a  component  or  the  binomial  distribution  for  either/or 
s ituatlons . 

d.  The  beta  probability  density  function  (pdf)  is: 

7?a  +  b)  (a  -  1)  (b  -  1) 

f(x)  -  ■■■■■«■—  X  (1  -  x)  ,  where  0  <  x  <  1 

T-  ft 

The  parameters  "a"  and  "b"  determine  the  degree  of  skewness  and  kurtosis. 
The  following  transformation  of  actual  high  (H)  and  low  (L)  points  of 
the  range  conform  to  the  beta  pdf  range  of  0  thru  I. 

x  •  (X-L)/(H-L)  -  L  ,  where  X  is  the  actual  data  value. 

The  computer  program,  given  the  beta  pdf  parameters,  randomly  selects 
x  and  then  transforms  it  to  X  for  each  iteration  through  the  network. 

e.  When  obtaining  subjective  probabilistic  Information,  the  author 
has  experienced  the  best  results  when  the  choices  available  to  the 
experts  have  the  following  characteristics: 

1.  Finite  end  points  which  exclude  extremely  unlikely  probabilities 

2.  Unlmodal 

3.  Continuous  rather  than  discrete 

4.  Few  input  parameters  required 

5.  A  finite  set,  with  visual  illustrations,  from  which  to  choose 


The  beta  distribution  also  met  the  first  four  elements  of  this  criteria. 
To  meet  criteria  five,  nine  representative  beta  distributions  were  sel¬ 
ected.  The  first  four  are  skewed  to  the  right  with  modes  25 Z  and  40Z 
of  the  way  through  the  range.  Distributions  five  through  seven  are 
symmetric  and  distributions  eight  and  nine  slightly  skewed  to  the  left 
with  the  modes  60Z  of  the  way  through  the  range.  These  nine  distribu¬ 
tions  are  displayed  in  Appendix  C. 

INPUT  REQUIRED: 

a.  To  determine  program  or  subprogram  uncertainties,  the  activities 
and  events  must  be  defined  and  their  interrelationships  established. 

This  is  best  depicted  in  a  PERT  type  network.  Although  it  is  not  the 
purpose  of  this  paper  to  describe  how  to  construct  this  network,  the 
following  general  comments  indicate  the  flexibility  available. 

1.  Branching  probability  paths  can  be  constructed,  e.g.,  probabil¬ 
ities  of  failure  causing  program  stop,  sufficient  problems  to  cause  major 
redesign,  or  adequate  success  to  continue  work  as  originally  planned. 

This  branching  may  be  activated  by  cost  and/or  time  constraints. 

2.  Activities  can  be  described  in  terms  of  time  or  cost  risk.  Care 
should  be  taken  to  include  the  interdependanc ies  of  events.  Activities 
may  have  to  be  subdivided  for  this  purpose,  e.g.,  design  of  item  A  into 
preliminary  design  and  final  design  of  A  because  the  prelimary  design 

of  A  is  required  before  item  B  can  be  designed. 

3.  Time  uncertainty  usually  assumes  a  normal  work  pace  (e.g.,  a  40 
hour  work  week).  Analysis  can  then  determine  critical  activities  which 
allows  management  the  option  of  selected  overtime  or  reallocation  of 
resources  and  awareness  of  which  activities/ events  to  monitor  closely. 
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4.  Cost  is  frequently  determined  as  a  linear  function  of  time, 
l.e.,  cost  *  a  +  b x ,  where  a  Is  a  base  constant  and  b  Is  a  cost  per 
unit  of  time.  This  Is  based  on  the  close  relationship  betveen  cost 
and  time  where  time  is  a  function  of  technical  uncertainty. 

5.  Activities/ events  become  more  specific  as  a  program  Is  defined 
in  more  detail.  B.g.,  to  monitor  the  risk  in  an  ongoing  program,  the 
activities/events  for  the  next  6  months  are  In  more  detail  than  those 
farther  In  the  future  whereas  past  activities  are  now  given  a  fixed 
number . 

6.  A  well  constructed  program  network  may  combine  elements  of  all 
the  above. 

The  Inputs  required  for  risk  analysis  can  be  readily  seen  from  the 
developed  network.  The  suggested  procedure  which  follows  assumes  act¬ 
ivity  estimates  cannot  be  obtained  by  traditional  parametric 
statistical  relationships. 

b.  Parameters  required  to  describe  an  activity's  uncertainty,  using 
the  beta  distribution,  are:  the  lover  and  upper  bounds,  the  most  likely 
value,  and  a  choice  of  one  of  the  nine  beta  distributions  shovn  In 
Appendix  C.  Note  that  there  is  a  redundancy  between  the  most  likely 
value  and  the  beta  distribution  selected.  This  redundancy  provides  a 
check  on  the  consistency  of  the  Information  provided. 

1.  The  high  (H)  or  pessimistic  bound  assumes  significant  aspects 
of  the  activity  develop  problems  but  excludes  extremely  unlikely  or 
catastrophic  occurrences  such  as  a  tornado  destroying  a  prototype  or 
a  national  transportation  strike.  There  should  be  little  chance  of 
exceeding  this  bound  -  a  workable  guideline  is  no  more  than  one  chance 


in  a  hundred. 


2.  The  low  (L)  or  optimistic  bound  la  defined  similarly  to  the 
high  estimate,  except  the  most  favorable  conditions  exist. 

3.  The  most  likely  value  or  mode  (M)  is  that  estimate  which  has 
the  greatest  possibility  ot  occurring. 

4.  Unless  the  distribution  is  symmetric  around  the  mean,  the  mode 
is  different  from  the  mean.  The  above  terms  are  illustrated  by  a 
hypothetical  example  in  Appendix  D. 

DATA  COLLECTION: 

a.  Unless  the  person  providing  the  information  has  experience 
in  this  method  of  estimating,  the  personal  interview  method  is  pre¬ 
ferred.  Although  it  may  require  more  time  and  money,  the  analyst 
has  more  confidence  in  the  reliability  of  the  Inputs.  When  two  or 
more  estimators  are  available,  the  Delphi  technique  may  be  used. 

Other  data  collection  techniques  are  discussed  in  DARCOM  Handbook 
11-1.1-79,  Reference  2. 

b.  Some  general  points  the  interviewer  should  consider  are: 

1.  He(s)  must  understand  and  be  able  to  describe  the  program, 
scope  of  work,  and  the  network  in  adequate  detail  to  answer  questions 
by  the  estimator  and  to  ask  the  right  questions. 

2.  Allow  sufficient  time  for  the  interview.  Try  to  pick  a 
setting  which  minimizes  interruptions. 

3.  The  mode  is  the  point  most  likely,  i.e.,  the  point  with  the 
most  chance  of  being  correct.  It  may  not  be  the  mean  or  expected 
value.  To  assist  the  interviewer,  the  modes  and  means  are  given 

in  Appendix  C  with  the  nine  beta  distributions.  Also  given  are 
the  areas  under  the  decile  and  quartlle  tails  of  the  distributions. 


4.  The  low  and  high  points  of  the  range  should  be  reasonable* 
This  Includes  the  possibility  that  many  events  could  be  favorable 
or  unfavorable  but  nothing  catastrophic  would  happen. 

5.  Because  of  the  redundancy  in  input,  the  interviewer  can 
quickly  check  for  consistency.  However,  an  atmosphere  of  coopera¬ 
tion  should  be  promoted  to  minimize  defensive  reactions.  Also, 
the  interviewer  should  be  careful  to  not  Introduce  bias  into  the 
the  estimates  received. 

6.  The  interviewer  should  remain  alert  to  the  estimator's 
understanding  of  the  process  and  his  knowledge  of  what  is  being 
estimated . 

7.  As  a  result  of  additional  data  acquired,  the  program  network 
may  need  to  be  revised. 


SAMPLE  CASE: 


a.  Situation:  A  missile  system  is  to  be  developed  using  an 
existing  proven  system  as  the  base.  The  only  major  change  will  be 

in  the  guidance  subsystem.  The  system  Is  composed  of  five  subsystems 
airframe  (A),  propulsion  (P),  guidance  (G),  peculiar  ground  support 
equipment  (PG)  and  common  ground  support  equipment  ( CG ) .  No  major 
problems  in  subsystem  interfaces  is  expected.  The  first  four  sub¬ 
systems  will  be  designed,  fabricated  or  modified  (DFM) •  These  four 
subsystems  will  then  each  be  component  tested  and  fixed  (CTF)  as 
necessary.  Meanwhile  CG  will  be  acquired  ( ACG ) .  Next  all  subsystems 
will  be  integrated  and  fixed  (IF)  as  necessary,  followed  with  a 
complete  system  test  (ST). 

b.  The  above  relationships  are  shown  in  Exhibit  1.  Event  names 
follow  the  abbreviations  above.  Figures  below  each  line  indicate  the 
beta  type  distribution  plus  the  low,  mode  and  high  cost  estimates. 
E.g.,  for  the  activity  CTFG 


the  guidance  subsystem  is  component  tested  and  fixed  as  necessary. 
The  cost  uncertainty  is  described  by  the  beta  type  2  distribution 
with  a  range  from  100  to  200  and  a  mode  of  125.  Exhibit  2  portrays 


the  same  data  in  tabular  form. 


SAMPLE  CASE  DATA 


BeCa  Parameters 


Activity 

a 

b 

L 

M 

H 

E[x] 

Sim 

DFMA 

3. 

4. 

160. 

200  . 

260. 

203  . 

203. 

DFMP 

2. 

2.5 

220. 

300. 

420. 

309. 

301  . 

DFMG 

2. 

4. 

400. 

500. 

800. 

533  . 

536  . 

DFMPG 

2. 

4. 

40. 

50. 

80. 

53. 

53. 

ACG 

3. 

3. 

40. 

50. 

60. 

50. 

50. 

CTF  A 

3. 

4. 

16. 

20. 

26. 

20. 

20. 

CTFP 

3. 

4. 

60. 

80. 

1 10. 

81  . 

82  . 

CTFG 

2. 

4. 

100. 

125. 

200. 

133. 

132. 

CTFPG 

2. 

2.5 

16. 

20. 

26. 

20. 

20. 

Sub  to  tal 

at  event  "J" 

1052  . 

1345. 

1982  . 

1402  . 

1  397  . 

IF 

2. 

4. 

150. 

200. 

350. 

217. 

215. 

ST 

2. 

2.5 

100. 

150. 

225. 

156. 

150. 

TOTAL  PROGRAM 

1  302  . 

1695  . 

2557  . 

1  7  75  . 

1  762  . 

*  Expected  value  for  the  normalized  beta  distribution  is  a/(a+b), 
which  is  converted  by  multiplying  by  the  range  and  adding  the  lower 
limit . 

**  Activity  mean  values  resulting  from  simulating  the  activities  by 
1000  iterations  through  the  network  using  the  VERT  model. 
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c .  Analysis : 

1.  Although  the  node  is  that  value  which  occures  most  often,  it 
is  not  the  expected  value  for  an  activity*  (Reference  example  in 
Appendix  D.)  In  the  Sample  Case,  the  point  estimate  for  the  total 
program,  determined  by  adding  the  modes,  is  1695  whereas  the  sum  of 
the  activity  expected  values  is  1775.  The  mode  method  underestimates 
the  costs  by  80  units  or  5  percent.  The  mode  method  typically  under¬ 
estimates  a  program's  cost  or  time  when  the  program  component 
activities  are  skewed  to  the  right,  l.e.,  the  range  of  an  overrun 
exceeds  that  of  an  underrun.  The  program  total  mean  value,  as  deter¬ 
mined  by  simulation,  will  normally  not  equal  the  expected  mean  value 
because  of  the  random  selection  of  activity  values  during  simulation; 
however,  the  two  methods  should  have  totals  within  ±  1  percent. 
Although  the  point  estimate  as  determined  by  the  expected  value  or  by 
simulation  is  superior  to  the  mode  method,  the  decision  maker  still 
has  no  quantification  of  the  uncertainties  about  the  point  estimate, 
i.e.,  some  measure  of  how  much  the  estimate  could  be  in  error. 

2.  Simulating  the  Sample  Case  network  by  Monte  Carlo  techniques 
provides  a  convolution  of  the  activity  probability  distributions  and 
provides  a  measure  of  the  uncertainty  around  the  point  estimate. 
Exhibit  3  displays  probabilities  and  costs  for  selected  events. 

E.g.,  using  the  beta  distribution,  there  is  a  75  percent  chance  that 
the  cost  of  the  program  will  equal  or  be  less  than  1831  units  or  a 

25  percent  chance  that  the  cost  will  exceed  1831  units.  Exhibits  4.1 
thru  4.3  display  the  VERT  output  for  the  Sample  Case  for  the  same 
events  summarized  on  Exhibit  3.  Using  the  VERT  model,  output  can  be 
generated  at  any  event. 
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3.  The  triangular  distribution  Is  frequently  used  to  describe 
activity  uncertainty.  The  reason  usually  given  for  its  use  is  a 
■ore  descriptive  distribution  is  not  justified  because  of  the  lack 
of  data.  There  are  occasions  when  this  argument  is  valid.  However, 
in  this  writer's  opinion,  this  rationale  is  often  used  as  rationali¬ 
zation  to  avoid  unfamiliar  and/or  more  arduous  methods.  Appendix  B 
compares  the  two  distributions.  The  Sample  Case  was  simulated  using 
triangular  distributions  in  place  of  the  beta  distributions.  The 
same  ranges  and  modes  for  each  activity  were  used.  The  results, 
using  the  triangular  vis-a-vis  the  beta  distributions,  are 
summarized  on  Exhibit  3. 


SAMPLE  CASE 


Probability  Points  for  Convoluted  Distributions 


Event  * 

Pr obab 11 ity 

Beta  Dlst . 

Triangular  Dist. 

XG 

.  10 

576 

598 

.25 

610 

638 

mean 

668 

705 

.75 

719 

763 

.90 

778 

837 

J  .  10 

1285 

1331 

.25 

1330 

1385 

mean 

1397 

1457 

.75 

1459 

1525 

.90 

1524 

1595 

FINISH 

.  10 

1632 

1712 

.25 

1689 

1  764 

mean 

1762 

1848 

.75 

1831 

192  7 

.90 

1899 

1994 

*  Costs  are  for  all  activities  leading  to  the  event. 

XG :  Completion  of  guidance  subsystem  prior  to  integration 
with  other  subsystems. 

J:  Coat  of  all  subsystems  before  system  integration. 
FINISH:  Cost  of  total  program. 
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CONCLUDING  REMARKS: 

The  desirability  and  even  the  necessity  for  quantifying  the  uncer¬ 
tainty  around  the  point  estimates  (time  or  cost)  for  new  or  ongoing 
programs  is  becoming  a  standard  procedure  within  the  Department  of  Army* 
The  professionalism  of  analysts  dictate  that  they  maintain  awareness  of 
new  and  revised  techniques.  Vlth  the  increasing  availability  of  effici¬ 
ent  and  fast  computer  equipment)  former  analytical  methods  can  now  be 
performed  economically.  Although  the  method  proposed  in  this  paper  is 
not  new,  Its  use  has  been  limited  by  unawareness,  availability  of 
computer  models  with  random  number  generators  for  many  probability 
distributions,  and  limited  computer  capability.  The  later  reasons 
are  no  longer  true  and  a  major  purpose  of  this  paper  is  to  promote 
more  widespread  avareness  of  the  capabilities  available  to  analysts 
and  decision  makers. 

Although  this  method  does  not  reduce  the  amount  of  uncertainty 
in  a  program,  it  does  attempt  to  quantify  them  in  a  more  precise  manner. 
Provided  with  this  additional  knowledge,  the  decision  maker  should  be 
able  to  make  better  decisions  and  allocations  of  our  available  resources. 
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Venture  Analysis  and  Review  Technique  is  proving 
Its  value  for  program  managers  who  need  to 
assess  the  risk  of  changes  in  cost ,  schedulef  or 
specifications. 
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The  weapona-system  acquisition  process  has  b«en 
subject  to  a  great  deal  of  criticism  in  the  last  dec¬ 
ade.  Poor  forecasting  has  contributed  to  cost  and  sched¬ 
ule  overruns  which  often  affect  our  national  defense 
capabilities  and  create  adverse  public  opinion.1  Faced 
with  public  and  Congressional  scrutiny,  managers  can  no 
longer  fall  back  on  "cost  growth"  as  an  excuse  for  such 
overruns,  and  will  be  tasked  more  than  ever  to  buy  the 
best  available  system  for  the  least  possible  cost  within 
the  prescribed  time  frame.  For  each  program  decision, 
the  program  manager  must  determine  the  best  balance 
among  three  parameters:  cost,  schedule,  and  perform¬ 
ance.  In  the  weapons-system  acquisition  process,  as 
contrasted  with  other  areas  of  management,  such  deter¬ 
minations  are  more  frequent  and  more  complex,  and  are 
made  with  less  of  the  essential  information.2  This  is  be¬ 
cause  of  the  inherent  uncertainty  involved  in  identifying 
and  resolving  the  technological  unknowns  of  developing 
programs. 

Uncertainty  creates  risk,5  but  risk  can  be  controlled  to 
some  extent  by  risk  analysis.  In  particular,  one  recently 
developed  quantitative  risk-analysis  method,  the  Venture 
Evaluation  and  Review  Technique,  is  proving  to  be  a 
powerful  program-management  tool  and  has  been 
applied  satisfactorily  to  several  system-development  pro¬ 
grams. 

Background 

Studies  of  weapons-development  projects  indicate  that 
most  cost  and  time  estimates  made  early  in  the  acquisi¬ 
tion  cycle  eventually  prove  to  be  lower  than  the  actual 
cost  and  time  for  development  This  cost  growth  and  time 
delay  can  be  attributed  principally  to  two  factors  of  the 
initial  estimates.4  First  the  inability  to  accurately  predict 
inflationary  trends  creates  an  inherent  cost-estimating 
error.  This  error,  however,  tends  to  be  small  in  relation  to 
the  second  factor— requirements  errors,  which  result  from 
contractual  changes  in  the  scope  of  work.  As  a  project 
develops,  operational  considerations  and  technical  inno¬ 
vation  necessitate  changes  in  performance  specifica¬ 
tions.  which  in  turn  affect  the  schedule  and  cost.  Such 
changes  are  most  pronounced  in  a  technically  complex 
research  and  development  project.  A  RANO  Corporation 
study  found  that  requirements  uncertainty  contributes  as 
much  as  30  percent  to  the  variations  in  cost  estimates.9 

These  technical-requirements  errors,  schedule  over¬ 
runs,  and  cost  overruns,  together  with  the  rapid  increase 
in  the  potential  enemy's  technical  capability,  influenced 
OoO's  decision  in  1970  to  accomplish  formal  risk  analysis 
as  an  integral  part  of  the  development  process.*  This  di¬ 
rective  raises  a  question:  how the  program  manager  to 
implement  formal  risk  analysis? 

Risk  analysis  is  not  npwflt  has  always  been  conducted 
to  varying  degrees,  based  on  subjective  judgment,  ex¬ 
perience,  and  qualitative  inputs.  Over  the  past  20  years, 
numerous  rifk^anaiysis  techniques  have  been  developed. 
Howeverrfhost  risk  analyses  are  intuitive  and  incomplete: 
intuitive  in  that  the  structured  quantitative  approach  often 
gives  way  to  hunches  and  blackboard  analysis;  incom¬ 


plete  in  that  detailed  analyses  of  isolated  aspects  of  the 
problem  are  rarely  integrated  into  a  comprehensive 
analysis. 

Because  the  three  parameters  of  cost,  time,  and  per¬ 
formance  are  highly  interrelated,  it  is  impossible  to  work 
with  each  factor  independently  without  introducing  er¬ 
rors.7  But  past  techniques  could  not  mathematically  rep¬ 
resent  the  three  parameters  and  their  interrelationships  in 
a  way  that  provided  the  program  manager  with  accurate 
risk  information  on  alt  three  parameters  simultaneously. 

Furthermore,  in  the  past,  military  procurement  of  major 
weapon  systems  often  sacrificed  the  cost  and  schedule 
parameters  in  order  to  maintain  prescribed  performance 
requirements.  In  the  1960s  attempts  to  alleviate  the  im¬ 
balance  led  to  changes  in  procurement  strategy.  Today, 
top  managers  in  the  Air  Force  Systems  Command  con¬ 
sider  cost  to  be  as  important  as  schedule  and  perform¬ 
ance. 

As  this  change  in  emphasis  was  evolving,  decision- 
management  techniques  were  also  changing.  The  Critical 
Path  Method  and  the  Program  Evaluation  and  Review 
Technique  were  developed  in  the  late  1950s.  These 
original  networking  techniques  were  useful  in  the  basic 
managerial  functions  of  planning,  scheduling,  and  con- 
troiing.  They  were  also  beneficial  in  laying  out  tasks  and 
in  making  gross  estimates  for  material,  equipment,  and 
manpower.  However,  both  techniques  assumed  unrealis¬ 
tically  that  all  activities  would  be  completed  successfully. 

In  the  mid-1960s,  the  Graphical  Evaluation  and  Review 
Technique  was  developed  as  the  first  computer-oriented 
networking  methodology.  From  this  evolved  the 
Mathematical  Network  Analyser,  developed  by  the  U  S. 
Army.  MATHNET  provided  the  capability  for  events,  ac¬ 
tivities,  activity  times,  and  cost  to  be  modeled  probabilis¬ 
tically. 

This  program  was  subsequently  modified  by  Army 
Logistics  Management  Center  personnel  and  renamed 
the  Risk  Information  System  and  Cost  Analysis.  RISCA 
provides  for  the  analysis  of  event  uncertainty,  but  it  does 
not  evaluate  the  risk  of  failing  to  attain  the  performance 


1  Herbert  L  Bevelhymer,  A  Proposed  Methodology  lor  Weapon 
Systems  Development  Risk  Analysis,  thesis,  Wnght- Patterson 
Air  Force  Base.  Ohio :  Air  Force  Institute  of  Technology.  June 
1973.  p.  2 
1  Ibid. 

5  For  purposes  ot  this  Article,  risk  will  be  defined  as  the  'prob¬ 
ability  of  not  being  able  to  acquire  a  weapon  system  of  speci¬ 
fied  performance  characteristics  within  an  allotted  time,  under  a 
given  cost  end  by  following  a  specific  course  of  action. "  ft.  ft. 
Lochry  et  at..  Final  Report  of  the  USAF  Academy  Risk  Analysis 
Study  Team,  Denver,  Colorado:  U.S.  Air  Force  Academy.  Au¬ 
gust  1971 
* ibid . 

*  Fisher.  Q.H.,  A  Oiscussion  of  Uncertainty  in  Cost  Analysis.  The 
Bend  Corporation,  April  1992. 

*  Deputy  Secretary  of  Defense  Memorandum,  May  29.  7970. 
subject:  Policy  Outdance  on  Me/or  Weapon  System  Acquisition 

'  Hamilton  T  Lenox.  Risk  Analysis,  thesis,  Wnght-Patterson  Air 
Force  Base.  Ohio:  Air  Force  institute  ot  Technology.  June  1973. 

p.  71. 
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objectives.  Thus  there  wau  still  a  need  to  include  the 
performance  variables  in  the  total  risk-analysis 
methodology.  This  was  accomplished  in  1973  with  the 
development  of  the  Venture  Evaluation  and  Review 
Technique.  Since  then,  VERT  has  been  used  almost  ex¬ 
clusively  by  Army  program  managers,  who  have  accepted 
it  as  a  flexible  and  valuable  tool.' 

The  Venture  Evaluation  and  Review  Technique  uses  a 
network-simulation  approach.  In  brief,  this  approach  de¬ 
termines  risk  analysis  through  two  steps.  The  first  step 
entails  constructing  a  graphic  representation  the 
network — the  ordered  series  of  activities  leading  to  spe¬ 
cific  events.  The  second  step  consists  of  analyzing  that 
network  using  a  computer  program.  The  following  exam¬ 
ple  illustrates  the  process. 

The  F-X,  a  hypothetical  fighter  under  development,  has 
three  major  components:  an  airframe,  an  engine,  and  an 
avionics  system.  The  desired  course  of  action  is  to  build 
each  subsystem  concurrently  and  integrate  them  later.  A 
model  of  the  essential  features  of  this  process  as  applied 
to  the  F-X  is  depicted  in  the  Figure.  The  nodes  (decision 
points)  in  the  network  represent  alternatives  which  de¬ 
termine  the  next  arc  (activity)  to  be  undertaken  in  the 
network.  Additionally,  the  size  of  the  problem  has  a 
bearing  on  how  the  network  is  structured.  If  the  problem 
is  large  and  complex,  it  is  often  advisable  to  construct 
lower  level  networks  or  subnetworks  of  major  subsys¬ 
tems.* 

Once  developed,  the  network  is  converted  to  VERT 
program  terminology.  The  program  has  a  variety  of  input 
capabilities  that  make  it  possible  for  decision  events  and 
activities  occurring  in  the  network  to  be  described.  Nu¬ 
merical  values  for  an  activity's  time,  cost,  and  perform¬ 
ance  are  assigned  to  each  arc.  At  each  node  the  next  arc 
is  determined  by  probabilities  or  by  some  criteria  speci¬ 
fied  by  a  mathematical  relationship. 

The  process  involves  a  Monte  Carlo  simulation  in 
which  the  design  of  a  network  flow  across  the  entire  net¬ 
work  or  subnetwork  from  the  beginning  to  an  appropriate 
end  point  leads  to  a  trial  solution  of  the  problem  being 
modeled.  On  the  F-X  fighter,  for  example,  simulation 
could  assess  the  activity  flow  across  the  total  develop¬ 
ment  program,  or  could  focus  on  the  flow  across  the 
wtng-developmenl  subnetwork. 

The  process  is  repeated  as  many  times  as  requested 
by  the  user  in  order  to  create  a  large  sample  of  possible 
outcomes.  Slack  time,  completion  time,  cost,  and  per¬ 
formance  results  are  generated  as  output  data  for  each 
node.  A  relative  frequency  distribution  depicts  the  range 


and  concentration  of  values  observed  at  a  given  node. 
Also,  the  probability  of  exceeding  certain  value  levels  can 
be  obtained  from  the  cumulative  frequency  distnbutions, 
and  confidence  levels  can  be  inferred. 

The  computer  program  produces  pictorial  histogram 
approximations  for  selected  nodes.  Thus,  a  program 
manager  would  have  an  integrated  risk  analysis  for  a 
particular  point  of  interest  in  his  program.  For  example, 
the  analysis  of  the  cost,  schedule,  and  performance  risk 
for  the  F-X  program  with  respect  to  meeting  the  sched¬ 
uled  Defense  Systems  Acquisition  Review  Council  mile¬ 
stones  could  be  expressed  in  the  following  manner 

Schedule  Risk.  The  probability  or  confidence  level  of 
being  within  eight  weeks  of  the  scheduled  DSARC  is  90 
percent;  the  probability  of  a  schedule  overrun  of  20 
weeks  or  more  is  5  percent. 

Cost  Risk.  The  total  cost  of  the  program  will  be  within 
$100  million  of  the  target  cost,  with  a  90  percent  confi¬ 
dence  level;  there  is  only  a  5  percent  probability  of  a  cost 
overrun  exceeding  $225  million. 

Performance  Risk.  The  confidence  level  of  being  within 
500  pounds  of  the  static  sea-level  thrust  specifications  is 
90  percent;  performance  nsk  could  be  indexed  to  other 
specifications  such  as  speed,  weight,  reliability,  and 
maintainability. 

The  conclusions  of  the  above  analysis  could  vary  as 
key  input  parameters  change  By  modifying  the  values  of 
the  input  data,  one  can  easily  rerun  the  model.  This 
sensitivity-analysis  capability  provides  the  decision 
maker  with  the  answers  to  many  hypothetical  questions 
For  example,  what  if  the  delivery  of  critical  avionics  com¬ 
ponents  on  the  F-X  were  to  take  three  weeks  longer  than 
originally  expected?  This  contingency  could  be  evaluated 
quickly.  By  substituting  the  "what  if"  data  and  rerunning 
the  simulation,  the  decision  maker  is  provided  with  new 
information.  Although  the  program  manager  is  the  ulti¬ 
mate  user  of  the  VERT  analysis,  the  majority  of  simula¬ 
tions  have  been  developed  and  run  by  the  systems  anal¬ 
ysis  or  program  control  offices  supporting  the  manager 
Yet  VERT  is  not  a  difficult  risk-analysis  technique  requir¬ 
ing  the  services  of  a  computer  programmer  or  systems 
analyst.  Ail  that  is  needed  is  an  individual  who  is  familiar 
with  basic  mathematics  and  computer  programming  and 
who  can  devote  about  a  week  of  continuous  study  and 
effort  to  master  the  model's  capabilities.’0  However,  such 
proficiency  would  be  required  only  in  simulating  the  most 
complex  or  unusual  risk  situations.  The  extent  to  which  a 
project  needs  to  be  segmented  into  activities  and  events 
is  a  function  of  the  available  data  and  the  results  desired. 
Breaking  down  complex  situations  into  subnetworks 
simplifies  the  programming  greatly  Some  managers 


*T.N.  Thomas,  VERT  A  Risk  Analysis  Technique  lor  Program 
Managers,  Defense  Systems  Management  Cortege,  May  1977 
p.  21. 

'  Qarald  Moerter,  VERT  Documentation.  Rock  island.  Illinois: 
U  S.  Army  Armamant  Command.  1979  Moerter  davalopad 
VERT  m  1973. 

,0  ibid.  p.  *. 
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VERT  Natworfc  For  Qevaiopmtnt  of  Hypothetical  F-X  Fighter 
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prefer  to  estimate  parameters  for  the  smaller  elemental 
items  rather  than  for  the  entire  system  or  for  higher-level 
work  packages. 

If  the  results  achieved  in  the  analysis  are  not  satisfac¬ 
tory.  the  program  manager  must  analyze  the  situation 
and  come  up  with  results  that  agree  with  his  subjective 
judgment.  When  the  proper  relationships  are  determina¬ 
ble  and  mathematically  tractable,  most  analysts  and  de¬ 
cision  makers  prefer  the  quantitative  approach."  In  the 
VERT  network-analyzer  program,  emphasis  must  be 
placed  on  establishing  proper  relationships.  Actual  con¬ 
ditions  must  be  represented  if  creditable  analytical  results 
are  to  be  produced.  The  desire  for  a  quantitative  answer 
or  analysis  should  not  force  the  analyst  to  disregard  or 
alter  critical  relationships  or  facts.  The  analyst  must  rec¬ 
ognize  not  only  his  own  limitations  but  those  of  VERT  as 
well. 

Program  application a 

The  Venture  Evaluation  and  Review  Technique  has 
been  used  in  support  of  several  Army  programs  and  at 
least  one  Navy  project.  One  of  the  most  noteworthy  ap¬ 
plications  of  VERT  occurred  during  the  1975  demonstra¬ 
tion  and  validation  phase  of  the  Army's  XM-l  Tank  de¬ 
velopment  program.  The  study  was  structured  to  examine 
the  XM-i  program  manager's  question:  given  a  decision 
to  proceed  into  fuil-acaie  engineering  development,  what 
is  the  risk  of  experiencing  unfavorable  schedule,  cost,  or 
system  performance  variances?  The  study  was  refined  to 
address  the  following  specific  objectives. 

•  Schedule  risk  expressed  as  a  time  distribution  for 
meeting  the  Army  System  Acquisition  Review  Council 
miles  tone. 

•  Coat  risk  expressed  as  cost-vanance  distnbutions  de¬ 
rived  from  schedule  analysis. 


•  Performance  risk  expressed  as  the  probability  of  ex¬ 
periencing  a  hardware  problem  that  would  significantly 
delay  completion  of  the  test  program. 

VERT  simulation  was  also  used  in  the  Cannon- 
Launched  Guided  Projectile  program  to  examine  the 
probability  that  the  development  effort  would  successfully 
reach  the  production  phase.  The  simulation  indicated  that 
there  was  a  95  percent  probability  of  at  least  one  man¬ 
ufacturer  qualifying  for  full  production.  It  also  indicated 
that  the  total  cost  of  the  program  would  run  about  S9  mil¬ 
lion  over  baseline  cost  if  there  were  a  9-month  extension 
in  the  schedule.12 

The  technique  has  also  been  used  in  support  of  the 
Army's  Platoon  Early  Warning  System,  the  M110E1  self- 
propelled  howitzer,  and  the  Advanced  Attack  Helicopter 
program.  On  the  helicopter  program.  VERT  was  used  to 
evaluate  the  validation-phase  schedules  through  the  sec¬ 
ond  Defense  Systems  Acquisition  Review  Council  mile¬ 
stone.  At  this  early  stage  of  development  there  was  con¬ 
siderable  risk  in  many  areas.  The  analysis  allowed  early 
identification  of  possible  impacts  caused  by  activities 
having  high  probabilities  of  not  occurring  as  planned.  The 
benefits  were  so  great  that  the  program  manager  re¬ 
quested  continuous  tracking  of  the  program  by  VERT 
simulation. 

To  explore  the  capabilities  of  the  risk-assessment 
technique,  the  Navy  ran  a  test  application  of  VERT  on  the 
radar  system  for  the  F- 18  aircraft.  The  risks  were  related 
to  new  performance  requirements,  and  the  simulation 
examined  the  amount  of  testing  to  be  conducted  in  the 
laboratory  versus  aboard  a  flight-test  aircraft.  Again,  the 


' '  itnoM.  p.  72. 

'  *  Jamas  a  Season.  Risk  Analysis  of  the  fSSAfM  Cannon- 
Lavnchad  Quidad  Protactita,  Rock  island,  mtnott:  U  S  Army 
Armamant  Command.  1978,  p.  * 
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analysis  provided  the  program  manager  with  valuable 
information. 

Problems  with  VERT 

Some  minor  problems  have  arisen  with  VERT,  but 
none  are  considered  major  obstacles  to  its  effective  use. 
The  most  frequent  problem  is  related  to  the  collection  of 
data  needed  to  describe  the  probabilistic  behavior  of  the 
variables  of  time,  cost,  and  performance.  Although  the 
VERT  program  is  capable  of  using  many  different  dis¬ 
tributions,  most  data  are  represented  by  a  triangular  dis¬ 
tribution  indicating,  for  example,  moat  pessimistic,  most 
likely,  and  most  optimistic.  This  Is  not  necessarily  wrong, 
but  it  does  not  really  use  the  capabilities  of  the  model, 
and  it  thus  reduces  the  accuracy  of  the  simulation  out¬ 
put ,J 

Another  common  data  problem  Is  the  inability  to  obtain 
from  the  experts  accurate  estimates  of  the  time  and  coat 
The  experts  tend  to  be  overly  optimistic  in  their  esti¬ 
mates,  but  this  problem  is  waning  as  they  are  coming  to 
realize  that  the  data  are  being  used  only  for  a  risk- 
analysis  simulation  and  will  not  cause  them  embarrass¬ 
ment  by  appearing  in  other  documents. 

More  cert  be  done 

Although  VERT  appears  to  be  quite  promising  and  de¬ 
void  of  major  problems,  it  has  not  enjoyed  wide  use.  One 
reason  for  this  lies  not  with  VERT,  but  with  the  in¬ 
adequate  understanding  of  risk-analysis  concepts  in  gen¬ 
eral.14  Many  program  managers  are  handicapped  by  a 
lack  of  familiarity  with  quantitative  risk-assessment  tech¬ 
niques.  and  few  people  in  the  military  services  are  ex¬ 
perienced  enough  to  perform  the  analysis.  In  Air  Force 
acquisition  programs,  for  example,  such  techniques  have 
not  been  used.  Similarly,  few  managers  are  accustomed 
to  using  the  outputs  of  a  risk  analysis.  For  instance, 
probability  distributions  depict  the  risk  of  development 
more  accurately  than  do  point  estimates;  yet  there  is 
widespread  resistance  to  probability  distributions  be¬ 
cause  of  their  unfamiliarity.’1 


'*  Thomas,  p.  17. 
'*  Locfl/y.  p.  107. 
'•  ibid. 
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Consequently,  an  education  program  is  needed  to  in¬ 
struct  analysts  and  managers  in  the  preparation  and  use 
of  formal,  quantitative  risk  analysis.  The  program  needs 
to  be  designed  to  emphasize  risk  analysis  for  high-level 
officials  who  deal  with  uncertainties  in  program  manage¬ 
ment  and  program  approval. 

Another  reason  that  VERT  is  not  used  often  is  the 
systems-acquisition  community's  failure  to  publicize  or 
offer  significant  training  in  VERT.  Consequently, 
program-management  personnel  are  unaware  of  the 
technique  and  its  possible  applications  m  the  program- 
development  environment.  The  Army  recognized  this 
shorttall  and  started  a  compret  tensive  course  of  instruc¬ 
tion  on  risk-analysis  techniques,  primarily  oriented  toward 
the  RISCA  methodology.  Now,  because  of  increasing 
interest  and  confidence  in  VERT,  the  Army  Logistics 
Management  Center  intends  to  emphasize  it  in  advanced 
risk-analysis  courses. 

Yet  another  reason  VERT  is  not  used  more  frequently 
is  the  problem  of  limited  numbers  of  personnel  and  a  high 
rate  of  personnel  turnover  in  program  offices.  No  agency 
outside  the  program  office  can  effectively  perform  a  risk 
analysis  of  that  program,  since  only  the  program  office 
has  the  necessary  data  to  work  with  the  program  man¬ 
ager  and  has  access  to  him  in  selecting  alternative 
courses  of  action.  Thus,  a  risk-analysis  team  is  needed  at 
the  product-division  staff  level  to  provide  the  corporate 
memory  necessary  to  implement  a  quantitative  risk  anal¬ 
ysis.  This  team  would  marry  the  mechanics  of  VERT  with 
the  data  source  in  the  program  office. 

As  the  use  of  VERT  increases,  knowledge  of  its  appli¬ 
cations  will  grow.  Further  applications  and  research  are 
necessary  to  confirm  its  validity  as  a  risk-assessment 
technique.  Users  need  to  be  encouraged  to  express  their 
reactions  to  the  technique.  These  reactions  should  be 
analyzed  to  ascertain  the  actual  benefits  being  achieved. 
This  investigation  could  lead  to  the  development  of  a  data 
bank  to  determine  the  degree  to  which  actual  program 
events  were  substantiated  by  the  model’s  predictions. 

The  Venture  Evaluation  and  Review  Technique  is  not 
necessarily  better  than  any  other  technique,  but  it  does 
provide  the  program  manager  an  accessible  tool  for  in¬ 
tegrating  cost,  schedule,  and  performance  parameters 
With  VERT,  the  program  manager  can  add  a  new  dimen¬ 
sion  to  the  analysis  of  program  decisions,  improving  the 
perspective  on  alternative  courses  of  action.  SMJ 
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BETA  VIS-A-VIS  TRIANGULAR  DISTRIBUTIONS 

SPECIFIC  EXAMPLE:  Compared  are  the  beta  type  2  distribution  and  a 
^r^*°8wlar  distribution,  both  vith  the  same  range  and  mode.  For  this 
case,  as  shown  on  the  graph  and  chart  below,  the  triangular  distribu¬ 
tion  has  significantly  less  area  in  the  low  range  and  more  in  the 
high  range.  Also,  the  expected  value  or  mean  of  the  beta  and  triangu¬ 
lar  distributions  shown  are  0.333  and  0.417  respectively. 
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GENERAL:  The  differences  described  above  are  for  a  specific  case  and 

will  change  with  different  shaped  beta  distributions.  Whereas  both 
distributions  include  the  parameters  of  range  and  mode,  the  beta 
parameters  include  a  shape  parameter  which  allows  greater  discretion 
in  describing  the  uncertainty  in  an  activity.  However,  under  certain 
conditions,  the  triangular  distribution  maybe  as  accurate  as  experi¬ 


ence  will  justify 
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Representative  Beta  Distributions 
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Hypothetical  Activity  Described  by  a  Beta  Distribution 


HYPOTHETICAL  EXAMPLE 


Mode  via-a-vis  Mean 


PROBLEM:  Hov  much  should  you  pay  Che  neighbor  boy  for  mowing  your  yard 

SITUATION:  The  price  Is  normally  a  fixed  price  arrangement.  You 

consider  $2.  an  hour  a  fair  price  and  moat  of  the  time  It  takes  2 
hours  to  do  the  job.  Many  times  there  Is  little  rain  and  the 
resulting  shorter  grass  can  be  mowed  more  quickly.  However.  If 
there  Is  some  wind,  small  branches  fall  on  the  lawn  and  the  boy 
must  pick  them  up  before  he  mows.  Occaslonly.  the  wind  blows  down 


many  branches.  Extremely  rare  occurances  are  Ignored,  e.g.,  extended 
draught  or  a  tornado.  You  estimate  the  job  will  take  from  1.5  to 
3.5  hours  with  the  most  likely  time  of  2.0  hours  and  a  distribution 
shaped  like  that  shown  below. 

CONCLUSION:  Since  the  distribution  Is  a  beta  distribution  with  a/b 

parameters  of  2/4,  the  average  expected  time  Is  2.17  hours  or  $4.34 
at  $2.  per  hour. 
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